Variable screening in multivariate linear regression with high-dimensional covariates
نویسندگان
چکیده
We propose two variable selection methods in multivariate linear regression with high-dimensional covariates. The first method uses a multiple correlation coefficient to fast reduce the dimension of relevant predictors moderate or low level. second extends univariate forward Wang [(2009). Forward for ultra-high dimensional screening. Journal American Statistical Association, 104(488), 1512–1524. https://doi.org/10.1198/jasa.2008.tm08516] unified way such that and model estimation can be obtained simultaneously. establish sure screening property both methods. Simulation real data applications are presented show finite sample performance proposed comparison some naive method.
منابع مشابه
Semiparametric Quantile Regression with High-dimensional Covariates.
This paper is concerned with quantile regression for a semiparametric regression model, in which both the conditional mean and conditional variance function of the response given the covariates admit a single-index structure. This semiparametric regression model enables us to reduce the dimension of the covariates and simultaneously retains the flexibility of nonparametric regression. Under mil...
متن کاملBoosting for High-multivariate Responses in High-dimensional Linear Regression
We propose a boosting method, multivariate L2Boosting, for multivariate linear regression based on some squared error loss for multivariate data. It can be applied to multivariate linear regression with continuous responses and to vector autoregressive time series. We prove, for i.i.d. as well as time series data, that multivariate L2Boosting can consistently recover sparse high-dimensional mul...
متن کاملTesting covariates in high-dimensional regression
Abstract In a high-dimensional linear regressionmodel, we propose a new procedure for testing statistical significance of a subset of regression coefficients. Specifically, we employ the partial covariances between the response variable and the tested covariates to obtain a test statistic. The resulting test is applicable even if the predictor dimension is much larger than the sample size. Unde...
متن کاملFaithful Variable Screening for High-dimensional Convex Regression By
We study the problem of variable selection in convex nonparametric regression. Under the assumption that the true regression function is convex and sparse, we develop a screening procedure to select a subset of variables that contains the relevant variables. Our approach is a two-stage quadratic programming method that estimates a sum of one-dimensional convex functions, followed by one-dimensi...
متن کاملOn Sliced Inverse Regression With High-Dimensional Covariates
Sliced inverse regression is a promising method for the estimation of the central dimension-reduction subspace (CDR space) in semiparametric regression models. It is particularly useful in tackling cases with high-dimensional covariates. In this article we study the asymptotic behavior of the estimate of the CDR space with high-dimensional covariates, that is, when the dimension of the covariat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Statistical theory and related fields
سال: 2021
ISSN: ['2475-4269', '2475-4277']
DOI: https://doi.org/10.1080/24754269.2021.1982607